Modality integration and dialog management for a robotic assistant
نویسندگان
چکیده
The communication with robotic assistants or companions is a challenging new domain for the use of dialog systems. In contrast to classical spoken language interfaces users interact with mobile robots mostly in a multi-modal way. In this paper we will present the integration of several modalities in the dialog system of BIRON – the Bielefeld Robot Companion. Besides speech as the main modality the system integrates deictic gestures and visual scene information in order to resolve object references in a task oriented dialog. We will present example interactions with BIRON and first qualitative results from the ”home-tour” scenario defined within the COGNIRON project.
منابع مشابه
STAIR: Hardware and Software Architecture
The STanford Artificial Intelligence Robot (STAIR) project is a long-term group effort aimed at producing a viable home and office assistant robot. As a small concrete step towards this goal, we showed a demonstration video at the 2007 AAAI Mobile Robot Exhibition of the STAIR 1 robot responding to a verbal command to fetch an item. Carrying out this task involved the integration of multiple co...
متن کاملMotivational Expression of Smart Walker for Rehabilitation Exercise
This paper presents the motivation expressions of Smart Walker, which is intended for use during rehabilitation exercise for the recovery of walking ability. Smart Walker is the application of a robotic system for the elderly. Its main purposes are to improve mobility and maintain balance, though it can also be used as a rehabilitation assistant for patients who have trouble walking as a result...
متن کاملINDIGO: Interaction with Personality and Dialogue Enabled Robots
The subject of this demonstration is human-robot interaction, focusing on robotic personality modelling and dialogue management. These are demonstrated in a museum guide use-case, operating in a simulated environment. The main technical innovations presented are the robotic personality model, the dialogue & action management system, and the robotic integration & simulation platform.
متن کاملFeasibility Study of a Robotic Medication Assistant for the Elderly
Management of complex medication regimens by older people poses a significant challenge wherein use of information technology could play a role in improving clinical efficacy and safety of treatment. The use of computing devices, however, presents a special challenge to older people given their physical and cognitive limitations. Robotic platforms show promise for extending the functionality of...
متن کاملCommunicating with Teams of Cooperative Robots
We are designing and implementing a multi-modal interface to a team of dynamically autonomous robots. For this interface, we have elected to use natural language and gesture. Gestures can be either natural gestures perceived by a vision system installed on the robot, or they can be made by using a stylus on a Personal Digital Assistant. In this paper we describe the integrated modes of input an...
متن کامل